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ABSTRACT 

It  is  shown  that  solutions  of  linear  inequalities,  linear  programs 
and  certain  linear  complementarity  problems  (e.g.  those  with  P-matrices 
or  Z-matrices  but^pot  semi  definite  matrices)  are  Lipschitz  continuous  with 
respect  to  changes  in  the  right  hand  side  data  of  the  problem.  Solutions 
of  linear  programs  arejjot  Lipschitz  continuous  with  respect  to  the 
coefficients  of  the  objective  function.  The  Lipschitz  constant  given 
here  is  a  generalization  of  the  role  played  by  the  norm  of  the  inverse  of 
a  nonsingular  matrix  in  bounding  the  perturbation  of  the  solution  of  a 
system  of  equations  in  terms  of  a  right  hand  side  perturbation. 
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SIGNIFICANCE  AND  EXPLANATION 


LIPSCHITZ  CONTINUITY  OF  SOLUTIONS  OF  LINEAR  INEQUALITIES, 

PROGRAMS  AND  COMPLEMENTARITY  PROBLEMS 

0.  L.  Mangasarian  &  T.-H.  Shlau 

I.  Introduction 

The  purpose  of  this  work  is  to  show  that  solutions  of  linear  inequal¬ 
ities,  linear  programs  and  certain  linear  complementarity  problems  are 
Lipschltz  continuous  with  respect  to  changes  in  the  right  hand  side  of  the 

problem.  Speaking  in  general  and  in  somewhat  loose  terms,  if  we  denote  by 
1  2 

r  and  r  ,  two  distinct  right  hand  sides,  then  there  exist  corresponding 
1  2 

solutions  x  and  x  such  that 

(1.1)  llx1  -  *2||  <  Kllr1  -  r2|| 

where  the  Lipschltz  constant  K  depends  only  on  the  matrix  defining  the 
problem,  but  not  on  the  right  hand  sides  nor  the  objective  function  if  there 
Is  one.  A  key  role  In  determining  the  Lipschltz  constant  K  Is  played  by 
the  condition  number  for  linear  Inequalities  Introduced  in  [8]  which  is  a 
generalization  of  the  very  useful  concept  of  a  condition  number  for  a  non- 
singular  square  matrix  [2].  In  [15]  Robinson  obtained  local  Lipschltz 
continuity  results  for  generalized  equations  which  Include  linear  programs, 
convex  quadratic  programs  and  monotone  linear  complementarity  problems. 
Robinson's  Lipschltz  constant  [15,  Theorem  2]  Involves  a  bound  on  the  solu¬ 
tion  set  which  Is  assumed  to  be  bounded.  By  constrast  our  Lipschltz 
constants  are  global,  and  our  solution  sets  need  not  be  bounded. 
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We  give  now  a  summary  of  our  principal  results.  Theorem  2.2  deals  with 
a  system  of  linear  Inequalities  and  equalities  (2.1)  and  shows  that  If  the 

system  Is  solvable  for  right  hand  sides  r  and  r  ,  then  for  each  solution 

11  2 
x  for  right  hand  side  r  there  exists  a  solution  x  for  right  hand  side 

r  such  that  (1.1)  holds.  The  Llpschltz  constant  here  plays  the  same  role  as 
the  norm  of  the  Inverse  of  a  nonsingular  matrix  does  for  a  system  of  linear 
equations.  Our  Llpschltz  constant  for  the  system  (2.1)  defined  by  (2.5),  Is  a 
minor  variation  of  the  constant  (6)  of  [8].  Furthermore,  the  Llpschltz  con¬ 
tinuity  Theorem  2.2  leads  In  a  very  elementary  way  to  Theorem  2.2'  which  Is 
essentially  equivalent  to  Theorem  1  of  [8]  and  which  gives  an  estimate  of 
the  error  In  an  approximate  solution  to  the  systems  of  linear  inequalities 
and  equalities  (2.1)  in  terms  of  the  residual  of  the  approximate  solution 
and  the  Llpschltz  constant.  Again  the  role  played  In  Theorem  2.2'  by  the 
Llpschltz  constant  Is  an  extension  of  the  same  role  played  by  the  norm  of 
the  Inverse  of  a  matrix  for  a  system  of  linear  equations.  Computation  of 
the  Llpschltz  constant  (2.5)  for  the  system  of  linear  Inequalities  and 
equalities  (2.1)  Is  quite  difficult,  but  an  important  fact  Is  that  such  a 
constant  exists  and  Is  finite.  For  some  special  cases  such  as  when  we  have 
strongly  stable  linear  Inequalities  only  (that  Is  linear  inequalities  solv¬ 
able  for  all  right  hand  sides)  the  Llpschltz  constant  can  be  computed  by  a 
single  linear  program  as  in  (2.17)  below.  By  using  the  Lipschitz  constant 
for  linear  Inequalities  and  equalities  we  show  In  Theorem  2.4  that  solutions 
of  linear  programs  are  also  Llpschltz  continuous  with  respect  to  right  hand 
side  perturbations  only.  Proposition  2.6  shows  that  our  Lipschitz  constant 
(2.20)  for  the  linear  program  (2.18)  Is  sharper  than  that  of  Cook  et  al 
[3,  Theorem  5].  By  means  of  a  simple  example  (2.26),  we  show  that  solutions 


of  linear  programs  are  not  Lips chi tz  continuous  with  respect  to  perturba¬ 
tions  in  the  objective  function  coefficients.  Finally  in  Section  3  by  using 
the  Lipschitz  constant  for  linear  inequalities  and  equalities  we  establish 
in  Theorem  3.2  Lipschitz  continuity  of  solutions  of  linear  complementarity 
problems  with  respect  to  right  hand  side  perturbations  that  generate  unique 
solutions  along  the  line  segment  joining  perturbed  and  unperturbed  right 
hand  sides.  A  simple  consequence  of  this  result  is  Theorem  3.3  which  shows 
that  the  solution  of  a  linear  complementarity  problem  with  a  P-matrlx  (that 
is  a  matrix  with  positive  principal  minors)  is  Lipschitz  continuous  with 


respect  to  right  hand  side  perturbations.  Example  3.4  shows  that  solutions 
of  positive  semidefinite  linear  complementarity  problems  are  not  Lipschitz 
continuous  with  respect  to  their  right  hand  sides.  Finally  by  exploiting  the 
fact  that  for  certain  classes  of  matrices  such  as  Z-matrices  (real  matrices 
with  nonpositive  off-diagonal  elements)  the  linear  complementarity  problems 
can  be  solved  as  a  linear  program  [7],  Lipschitz  continuity  of  solutions  of 
such  linear  complementarity  problems  are  obtained  in  Theorem  3.5. 

A  brief  word  about  notation  and  some  basic  concepts  employed.  For  a 
vector  x  in  the  n-dimenslonal  real  space  Rn,  |x|  and  x+  will  denote  the 
vectors  in  Rn  with  components  |x|^:=  jx^|  and  (x+)^:=  max  {x^ ,  0},  1*1,..., 
respectively.  For  a  norm  || x|j ^  on  Rn,  ||x||g*  will  denote  the  dual  norm 
[6,13]  on  Rn ,  that  Is  ||x|L*:=  max  xy,  where  xy  denotes  the  scalar  prod 

n 

uct  ][  x^.  The  generalized  Cauchy-Schwarz  Inequality  | xy J  <  ||x||g*  ||y||0* 


for  x  and  y  in  R  ,  follows  Immediately  from  this  definition  of  the  dual 


norm.  For  1  £  p,  q  <  ®,  and  -]-  +  ]-  =  1 ,  the  p-norm  (  l  | xJp)  and  the 


1/P 


r*  /  *  <*. 


q-norm  are  dual  norms  on  Rn  [13].  If  IMIg  Is  a  norm  on  R  ,  we  shall, 
with  a  slight  abuse  of  notation,  let  H*||g  also  denote  the  corresponding 
norm  on  Rm  for  m  f  n.  For  an  mxn  real  matrix  A,  denotes  the  1th 
row,  A.j  denotes  the  jth  column,  Aj:=  A.|e|,  and  A.j:  =  A.jeJ,  where 

I  c  {l . m}  and  J  c  {1 . n}.  |) A|| ^  denotes  the  matrix  norm  [13,16] 

subordinate  to  the  vector  norm  |Hlg>  that  Is  ||A||g  a  max  |[ Ax [| ^.  The 

consistency  condition  ||Ax||g  <  H A|] ^|| x || ^  follows  Immediately  from  this 
definition  of  a  matrix  norm.  A  monotonic  norm  on  Rn  Is  any  norm  ||*||  on 
Rn  such  that  for  a,  b  In  Rn,  •  ||a||  <  jjb||  whenever  |»|  <  |b|  or  equiva¬ 
lently  If  || a ||  »  ||  | a |  ||  [6,  p.  47].  The  p-norm  for  p  _>  1  Is  monotonic 


[13].  A  vector  of  ones  In  any  real  space  will  be  denoted  by  e.  The 


Identity  matrix  of  any  order  will  be  denoted  by  I.  The  nonnegative  orthant 


in  Rn  will  be  denoted  by  R”.  The  abbreviation  rhs  will  denote  "right  hand 


side". 


NW.O.s. 
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Llnear  Inequalities  and  Programs 

We  shall  first  be  concerned  with  Lipschitz  continuity  of  solutions  of 


the  following  set  of  linear  inequalities  with  respect  to  changes  in  the 
right  hand  side 


(2.1)  Ax  <  b,  Cx  =  d 

where  b  and  d  are  given  points  in  Rm  and  Rk  respectively,  AeRmxn, 

fcxn 

that  is  an  mxn  real  matrix  and  CeR  .We  shall  employ  a  slight 
variation  of  the  condition  constant  introduced  in  [8,  Equation  (6)]  for 
linear  inequalities  and  programs  as  our  Lipschitz  constant  for  the  linear 
inequalities  (2.1)  and  subsequently  for  the  linear  program  (2.18)  and  the 
linear  complementarity  problem  (3.1). 

We  begin  with  a  simple  extension  of  the  fundamental  theorem  on  basic 
solutions  [5,  Theorem  2.11]  to  unrestricted  as  well  as  nonnegative 
variables. 

2.1  Lemma  (Basic  solutions)  Let  A e  Rmxn ,  C e  Rkxn  and  peRn.  The  system 

(2.2)  A^u  +  C*v  =  p,  u  >  0 

...  L 

has  a  solution  (u,v) e  R  If  and  only  If  it  has  a  basic  solution,  that 
Is  a  solution  (u,v)  such  that  the  rows  of  corresponding  to  nonzero 
components  of  (u,v)  are  linearly  independent. 


Proof  The  system  (2.2)  having  a  solution  (u,v)  implies  that 

(2.3)  ATu  +  CTv  =  p,  (u,v)  >  0 


has  a  solution  where  C  is  obtained  from  C  by  multiplying  by  -1  those  rows 


of  C  corresponding  to  negative  components  of  v.  It  follows  from  the 
fundamental  theorem  on  basic  solutions  [5,  Theorem  2.11]  that  (2.3)  has  a 


basic  solution  and  consequently  so  does  (2.2).  □ 

We  proceed  now  to  establish  Llpschltz  continuity  of  solutions  of  (2.1) 
with  respect  to  right  hand  side  perturbations. 


2.2  Theorem  (Llpschltz  continuity  of  feasible  points  of  linear  Inequalities 

and  equalities)  Let  the  linear  Inequalities  and  equalities  (2.1)  have  non- 

12  11 
empty  feasible  sets  S  and  S  for  the  right  hand  sides  (b  ,  d  )  and 

2  2  11  2  2 
(b  ,  d  )  respectively.  For  each  x  €  S  there  exists  an  x  e  S  closest 

to  x1  In  the  °°-norm  such  that 


Proof  We  note  that  yg{A;  C)  Is  finite.  For  If  not,  there  would  exist 

fixed  subsets  I  and  J  of  {l,...,m}  and  {l,...,k}  respectively  and  a 

A  ' 

sequence  {uj.Vj}  such  that  (||u|,Vj||>  -*■<*>  and  the  rows  of  q*  are 

U  i  j  .  U  1* 

linearly  independent.  Hence  a  subsequence  {(Uj  ,  vj  )/lluj  »  Vj  || }  con¬ 
verges  to  (uj.Vj)  satisfying  UjAj  +  VjCj  =  0,  ||uj,vJ|  =  1,  which 


fAIl 

contradicts  the  linear  independence  of  the  rows  of  r  . 

nJ 

11  2  2  1 
Now  let  x  eS  .  Choose  x  eS  which  is  closest  to  x  in  the  ®-norm. 

2 

Thus  x  must  solve 

(2.6)  min  ||x  -  x^  s.t.  Ax  ,<  b2,  Cx  =  d2 

x 

which  is  equivalent  to  the  linear  program 

2  2  1  1 

(2.7)  min  6  s.t.  Ax  £  b  ,  Cx  =  d  ,  x  +  e6  :>  x  ,  -x  +  e6  >  -x 

x,6 

Hence  (x2,  62)  and  some  (u^v^rils^)dl,,^+2ri  satisfy  the  following 
Karush-Kuhn-Tucker  conditions  for  (2.7) 

Ax2  <  b2,  Cx2  =  d2,  || x1  -  x2!^  =  62 

(2.8)  ■  u2(-Ax2  +  b2)  =  0,  r2(x2  +  e62  -  x1 )  =  0,  s2(-x2  +  e<52  +  x1 )  =  0 

-u2A  +  v2C  +  r2  -  s2  =  0,  e(r2  +  s2)  =  1 ,  (u2,  r2,  s2)  >  0 

. 

Note  that  if  o  =  «2  •  ||x’ -x2||„-  than  (2.4)  Is  trivially  true.  So  assume 
that  6^  >  0.  It  follows  from  6^  >  0  and  r?(x*  +  e6^  -  x* ) .  =  0  and 

w  J 

s2(-x2 +  e62  + x1 )j  =  0  that  r^s2  ■  0,  for  j=l,...,n.  Hence 


(2.9)  -u2A  +  v2C  +  r2 


s2  =  0,  e(r2  +  s2)  =  1 ,  r2s2  =  0,  (u2,  r2,  s2^  -  0 


By  Lemma  2.1  it  follows  that  we  may  take 


=  fui] 


A. 

such  that  the  rows  of  r  are  linearly  Independent.  Hence  (2.9)  becomes 


,*  f-  I* 
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"UIAI  +  v jcjll -j  -  l|r2-s2||,  *  .<r‘*s‘>  =  1.  U\  >  0, 


2  .  _2> 


Rows  of  r  lin.  Indep. 
.  J 


Hence  by  (2.5)  we  have  that 


(2.10) 


“  <  U@(A; 0 


We  now  have 


||X1-X2||00  -  6*  =  -bV  +  dV  +  x'(r‘-s‘) 

=  -b2u2+  d2v2  +  x1  (ATu2  -  CTv2) 

-  u2(Ax]  -  b2  +  b1  -  b1 )  +  v2(-Cx]  +  d2  +  d1  -  d1 ) 

<  u2(b1  -b2)  +  v2(d2-d1) 

<  u2  b1  -  b2 


2..2 , 2.2  A  1,2  ,2, 


(2.11) 


hl  h2 
<  V6(A;  C)  ^  -  g 


(By  (2.10)) 


Note  that  the  Lipschitz  constant  y^(A;  C)  of  (2.4)  plays  the  same 
role  as  that  of  the  norm  of  the  Inverse  of  a  nonsingular  matrix  of  a  system 
of  linear  equations.  This  fact  can  be  seen  more  clearly  from  the  following 
corollary  to  Theorem  2.2,  Note  also  that  we  can  get  a  sharper  result  by 
replacing  (^-b2),  in  (2.4)  and  (2.11)  onward,  by  (b1  -b2)+. 


2.3  Corollary  (Lipschitz  continuity  of  feasible  points  of  strongly  stable 
linear  inequalities)  Let  AeRmxn  and  C  £  R^n  be  such  that 


(2.12) 


Rows  of  C  are  linearly  independent  and 
Ax  <  0,  Cx  =  0  has  a  solution  x 


Then  the  linear  inequalities  (2.1)  are  solvable  for  all  right  hand  sides 

(b,  d)  e  Rm+k.  For  each  x^  in  the  solution  set  of  (2.1)  with  rhs  (b'.d^), 

2  2  2 
there  exists  an  x  in  the  solution  set  of  (2.1)  with  rhs  (b  ,  d  )  such  that 


(2.13) 


lx1  -  x2!^  <  yg(A;  C) 


b1  -b2 
d]-d2 


where 


is  some  norm  on  Rm+*(  and 


(2.14) 


ilg(A;C):=  max 


(u,v)eR 


,m+k 


' 

u 

* 

V 

e* 

|  uA  +  vC  I!  ^  =  1 
u  >  0 


Proof  That  (2.1)  is  solvable  for  any  right  hand  side  (b,d)  follows  from 

solving  Cx  =  d  for  x^  for  any  given  d  and  then  taking  as  the  desired 

solution  x^  +  Xx  for  sufficiently  large  positive  X,  where  x  solves 

Ax  <  0,  Cx  =  0.  The  rest  of  the  proof  of  the  corollary  is  similar  to  the 

2  2 

proof  of  Theorem  2.2,  except  that  u  and  v  are  not  decomposed  into 


2] 

UI 

and 

[■9 

loj 

loj 

The  finiteness  of  pD(A;C)  of  (2.14)  follows  from  the 

P 


boundedness  of  the  feasible  region  of  (2.14).  For  it  were  unbounded,  there 
would  exist  {u^v1}  such  that  {||u1,v1||  -*-<*>  and  consequently  an 
accumulation  point  (u,v)  would  exist  such  that 


(2.15) 


uA  +  vC  =  0,  u  >.  0,  (u,  v)  f  0 


This  however  would  contradict  the  linear  independence  of  the  rows  of  C  if 
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u  3  0,  and  If  u  f  0  would  contradict  the  solvability  of  Ax  <  0,  Cx  =  0, 

because  then  0  =  uAx  +  vCx  =  uAx  <0.  □ 

Note  that  If  A  Is  vacuous  and  C  Is  a  nonsingular  square  matrix,  then 

(2.16)  5J*;C)  -  max  {||v||,  |  ||vC||,  •  1)  -  ||(CTf1||1  =  ||C',||„ 

vcRk 


This  was  already  pointed  out  In  [8,  Remark  2].  Note  also  that  (2.14)  can 
be  written  In  the  equivalent  form 


(2.14*) 


y6(A;C)  = 


max 


(u.v.zJeR1 


m+k+n 


8* 


-z  <  uA  +  vC  <  z 


This  is  a  difficult  convex-function  maximization  problem  on  a  polyhedral  set 
which  Is  closely  related  to  the  NP-complete  problem  of  a  norm-maximization 
problem  on  a  polyhedral  set  for  positive  Integer  8*  [9],  However  for 
B*  *  «,  that  Is  8  =  1,  It  can  be  shown,  as  In  [9],  that  (2.14')  Is  In  P. 

In  addition  a  good  bound  for  iig(A;  C)  for  any  8  can  be  obtained  by  solv¬ 
ing  a  single  linear  program  [9].  When  C  Is  empty  and  8  =  ®,  (2.14') 

degenerates  to  the  following  linear  programs 

(2.17)  Ci0O( A ;  4>)  =  max  (eu|-z ^uA^ z,  u^O,  ez  =  1 } 

(u,z)€Rffl+n 

We  note  that  the  Llpschltz  constants  vig(A;  C)  and  ii^CA;  C)  which  play 
the  role  of  the  norm  of  the  inverse  of  a  nonsingular  matrix  of  a  system  of 
linear  equations,  can  also  be  used,  just  as  the  norm  of  the  Inverse  can,  to 
obtain  a  bound  on  the  error  In  an  approximate  solution  In  terms  of  the 
residual.  Thus  if  we  assume  for  the  moment  that  A  Is  vacuous  and  that  C 


is  nxn  and  nonsingular,  then  iig(<j»;  C)  *  || || ^  by  (2.16).  Thus  (2.5) 
and  (2.13)  are  the  extensions  to  a  system  of  linear  Inequalities  and 
equalities  of  the  following  simple  Llpschltz  continuity  property  of  Cx  *  d 

y»,-**ll.<  IIC'1ll.l|d1-dJIL 

111  212  1 
where  x  =  C  d  and  x  *  C  d  .  Since  ||C  can  also  be  used  to 

estimate  the  error  in  an  approximate  solution  x  to  Cx^  ■  d^  In  terms  of 

its  residual  HCx-d1^  as  follows 

*  i|c‘,(cx-d’)IL  <  llc-'ii.licx-d'n. 

It  follows  that  the  Llpschltz  constants  y-( A;  C)  and  yD( A;  C)  can  be 

P  P 

similarly  used  to  give  an  estimate  on  the  error  In  an  approximate  solution 
to  (2.1)  In  terms  of  Its  residual.  In  fact  this  estimate  was  given  In 
[8,  Theorem  1],  but  It  also  follows  very  easily  from  Theorem  2.2  above  as 
follows. 

2.2*  Theorem  (Error  bound  for  approximate  solution  of  linear  Inequalities 
and  equalities)  Let  the  linear  inequalities  and  equalities  (2.1)  have  a 
nonempty  feasible  set  S1  for  the  right  hand  side  (b^d1).  For  each  x 
in  Rn  there  exists  an  x1  e  such  that 

Ilx-  xlL  <  M6(A;  0  j 

Cx-d  B 

where  y^( A; C)  is  defined  by  (2.5). 

Proof  Since  for  each  xeR0 


1 


Ax  ^  b  +  ( Ax  -  b  )  + ,  Cx  =  d  +  ( Cx  -  d  ) 

it  follows  by  Theorem  2.2  that  there  exists  an  x1  e  S1  such  that  the 
conclusion  of  the  theorem  holds.  □ 


A  similar  error  bound  holds  for  strongly  stable  linear  inequalities 
which  Is  based  on  (2.13). 

It  is  Interesting  to  note  that  Theorem  2.2  is  stronger  than  Theorem  2.2' 
In  the  sense  that  the  latter  follows  directly  from  the  former  as  was  demon¬ 
strated  above,  whereas  the  converse  holds  with  the  additional  assumption  that 
the  norm  ||*||g  is  a  monotonic  norm  [6,  13].  Thus  to  obtain  Theorem  2.2 

from  Theorem  2.2',  we  have  from  Theorem  2.2'  that  for  each  x1  e  S1  there 

2  2 

exists  an  x  e  S  such  that 


?  t  (Ax1  -  b2),  b]-b2 

lx  ‘x  IL  <  M6(A;0  i  2  <.  Ug(A;  C)  ,  , 

Cx  -  d  B  d  "  d  B 


where  the  last  Inequality  follows  from 


(Ax1  -  b2)+  =  (Ax1  -  b2  +  b1  -  b1 )+  <  (b1  -  b2)+  <  | b1  -  b2| 

|  Cx1  -  d2 1  =  |  Cx1  -  d2  +  d1  -  d1 1  =  |  d1  -  d2 1 

and  the  monotonicity  of  the  norm  IMIg  . 

Next  we  establish  the  Lipschitz  continuity  with  respect  to  right  hand 
side  perturbation  of  solutions  of  the  linear  program 


(2.18) 


max  px  s .t.  Ax  <  b,  Cx  =  d 
x  “ 


• ' -\V/ .*/-•  v  .*,y /.  .*  v*. *.*'.• 

•  ®*»s"C**  vv  v**  3*y s* ' s'’  •"*, •"*  •  *,.»"*  ■* 


i 
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u 


where  peR  and  A,  b,  C,  d  are  as  in  (2.1).  For  the  Lipschltz  contin¬ 
uity  results  for  linear  programs  we  have  to  restrict  the  norms  employed  to 
monotonic  norms  [6,  13]  and  have  to  drop  u  >  0  from  (2.5). 

2.4  Theorem  (Lipschltz  continuity  of  solutions  of  linear  programs  with 
respect  to  rhs  perturbation)  Let  the  linear  program  (2.18)  have  nonempty 
solution  sets  and  S2  for  right  hand  sides  (b\d^)  and  (b2,  d2) 

11  7  7 

respectively.  For  each  x  eS  there  exists  an  x  eS  such  that 


(2.19) 


b1  -b2 

II  X  X  I  I  00  ~  ^  ]  ^2 


where  ||*|lg  is  some  monotonic  norm  on  Rm  K  and 


uA  +  vC||  i  ■  1 


(2.20)  v„(A;  C) :=  sup 

u,v 


Proof  Given  x1  e  S1 ,  let 


"  Rows  of  [ corresponding  to  nonzero 

e*  1  J  fu\ 

elements  of  “  are  Tin.  indep. 


b],  A.x1  <  bl 
I  J  J 


2  ,.2 


where  I u  J  *  {1 ,2,. .. ,m}.  Fix  any  x  e  S  and  let  I  =  1^  u  I2 


where 


I,:-  (1  e  1 1 A1x2  =  b2},  I2:=  (1  c  I j Aix2  <  b2} 


-2  .  .2, 


Since  x  =  x  satisfies  the  system  of  constraints 


.v.v.-.--.*.- v.  -v-. v-  v-v. ■*.  <.  ..........  ......... 

Zvv>,'-;Sy'v*v.Vv,v  1  I--\V  v' v"y’.\ •' :  .-.‘vy  ■;>•>!•  , . 


,  VV*»J 
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(2.21) 


(1)  A.  x  *  b!  , 
*1  M 


(11)  At  At  X|  Aj  X  <  b| 

a2  a2  a2  12 


(Hi)  AjX  <  b2,  Cx  =  d2 


It  follows  that  (2.21)  is  nonvacuous.  Let  xc  be  a  solution  of 


(2.22) 


rain  Hx-x1  !)„  s.t.  (2.21). 


Since  (2.22)  is  a  convex  program,  x  remains  optimal  after  we  remove  any 


number  of  Inactive  constraints.  For  each  1  e  1^,  at  least  one  of  the  two 


-2  2 

constraints  of  (2.21)  (11)  Is  Inactive  because  A^x  <  b^.  So  we  can 


remove  one  inactive  constraint  for  each  1  e  Ig  thus  obtaining 


(2.23)  ||x2-x1||oo  =  min  ||x-x1|L  S.t.  (2.24)  =  min  |j x  -  x1  s.t.  (2.21) 


where 


(2.24) 


(1)  At  x  *  b j 

*1  1 1 


(1  ia)  A«x2  <  A, ,x 


(11b)  ALx  <  b£ 


(11c)  AjX  <,  b2,  Cx  = 


where  K  u  L  =  I2>  Kn  L  *  $.  So  Ij  u  K  u  L  u  J  =  (1 ,2,. , .  ,m)  and  1^ ,  K,  L 


and  J  are  all  disjoint.  On  the  other  hand,  since 


Akx1  s  bj,  -  b2  +  b2  >  b],  -  b£  +  Afcx2 


it  follows  that  x  a  x  satisfies  the  following  system 


m 


< , '  ,  «*.  .v  ri 

.-<v/  ■  a  J 


// 


yvwXA- 


(2.24') 


(1)  At  X  a  by 

xi  h 

(11a)  bj,  -  b£  +  Akx2  <  Akx 
(lib)  Alx  <  b[ 

(11c)  AjX  <  bj,  Cx  =  d1 


It  follows  by  (2.23),  (2.24* ),  Theorem  2.2  and  the  norm  monotonicity  that 


K  fAr 


llx1  -x2|L  <  Vo  AL  ;  1 


‘bK+bK 

b^b2 

d1  -d2 


b’.b2 

<  v0(A;  C)  ^  ^  ^ 


where  H  =  I^uLuJ  is  the  complement  of  K. 

2  2  11 

It  remains  to  show  that  x  «S  .  Since  x  «S  ,  we  have  by  the 
Karush-Kuhn-Tucker  optimality  conditions  that 


(2.25) 


a|u j  +  C^V  =  p  for  some  u|  >  0  and  some  v^ . 


Since  both  x2  and  x2  satisfy  (2.21)  It  follows  that 


=  u}AiX2  +  v^Cx2  >_  UjAjX2  +  vVx2  =  px2 


and  the  proof  Is  complete. 


2.5  Remark  We  note  that  Cook-Gerards-Schrl jver  and  Tardos  [3,  Theorem  5] 
have  a  similar  result  to  Theorem  2.4  for  Integer  entries  for  A  but  without 


n  %  'Vfp  w  M  *  «  **  .«  ■<  •  -  .  1  T  rn  •*  •  *  *  < 
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the  equality  constraints  Cx  =  d.  However  their  Llpschltz  constant  Is  big¬ 
ger  than  or  equal  to  our  Llpschitz  constant.  In  fact  their  Llpschltz  con¬ 
stant  nA(A)  Is  only  for  6  =  00 ,  where  M  Is  the  maximum  of  the  absolute 
values  of  the  determinants  of  the  square  submatrices  of  A.  We  formalize 
the  relation  between  the  two  Llpschltz  constants  as  follows. 

2.6  Proposition  For  Integer  A,  v^A;  <J>)  <  nA(A). 

Proof  For  any  Uj  for  which  || UjAj |] ^  *  1  and  the  rows  of  Aj  are  lin¬ 
early  Independent,  we  can  assume  that 

Aj  =  [B  N] 

where  B  is  a  nonsingular  square  submatrix. 

Let  q:=  UjB,  then  ||q||  <  H ujAj || ^  «  1  since  UjB  Is  a  subvector 

of  UjAj.  It  follows  that 

II "ill,  -  lid1)'1  oil,  <  l|(6Tr'll,  INI,  <  ||(BTr,||1  -  max  J  |hlJ| 

w 

where  h^.  is  the  (1,j)  entry  of  B"1  [13,  p.  22].  Hence 

hij  =  ■aeTT^"1^  Jej1  * 

where  B.^  is  the  (i,j)  cofactor  of  B  which  Is  the  determinant  of  a 

square  submatrix  of  A.  Hence 


B . .  < 

Ji  - 


A(A). 


If  A  Is  Integral  | det  B ]  1  Is  an  Integer,  hence 


Consequently 


h1jl  -T3IT6T  -  A(A)' 


II uill-j  i  IKB1)"1!!,  ■  max  l  |hij|  <  nA( A) . 


Since  Uj  Is  arbitrary,  we  have 


voo(A;  4>)  *  sup  {||uj  ||  JIIUjAj  11,-1.  rows  of  Aj  Tin.  1ndep.}<  nA(A). 

2.7  Remark  Note  that  It  Is  not  true  that  solutions  of  linear  programs 
are  Llpschltzlan  with  respect  to  perturbations  In  the  objective  function 
coefficients  as  evidenced  by  the  following  simple  example: 

(2.26)  max  (1 +6)x1  +  x2  s.t.  x1  +  x?  <  1 ,  (x1 ,  x2)  >  0 


The  solution  to  this  problem  Is: 


(1 , 0)  for  6  >  0 
(0,1)  for  -1  <  6  <  0 


Hence 


and  hence  x(6)  Is  not  Llpschltzlan  with  respect  to  6. 


*  *%**J*+ >  ' 


Linear  Complementarity  Problems 


In  this  section  we  shall  employ  the  Lipschltz  constant  p0(A;  C) 

p 

developed  in  Theorem  2.2  for  linear  inequalities  and  equalities  to  obtain 
a  Lipschltz  constant  for  linear  complementarity  problems  with  matrices 
that  have  positive  principal  minors  [4]  or  which  are  hidden  Z-matrlces 
[14].  We  will  show  by  means  of  Example  3.4  that  solutions  of  linear 
complementarity  problems  with  a  positive  semi  definite  matrix  are  not 
Lipschltz  continuous  with  respect  to  right  hand  side  perturbations. 

We  consider  the  linear  complementarity  problem  (M,q)  of  finding  an 
x  in  Rn  such  that 


(3.1) 


Mx  +  q  >_  0,  x  >  0,  x(Mx  +  q)  =  0 


where  MeRn*n  and  qeR11.  Note  that  given  Jc{l,...,n},  any  solution 
of  the  following  system  of  2n  linear  Inequalities  and  equalities 


(3.2) 


Mjx  +  '■j  -  °*  xj  ■ 0’ J  e  J 
¥  +  <>j  *  °*  xji°- 


Is  a  solution  of  (M,q).  For  J<=(l,...,n)  let  Q(J)  denote  the  set  of 

all  q  vectors  for  which  (3.2)  has  a  solution.  It  Is  easy  to  verify  that 

Q(0)  Is  a  closed  convex  cone.  In  fact  it  is  called  a  complementary  cone 

of  (M,  q)  [11,  p.  482].  It  Is  also  obvious  that  u  Q(J)  Is  the  set 

Jc{l , . . . ,n) 

of  all  q  for  which  (M,  q)  Is  solvable.  Define 


(3.3) 


Mj  1  1 

ofi(M):»  max  Ps  . 

6  0c{l . n)  e  Ij  *  Mj 


i. v  .‘•V-  .  *  v-V- -  »**Vv  rX.%  »*•  t’*  -  vV*‘ 
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where  is  defined  by  (2.5)  and  3  is  the  complement  of  J  in  (l,...,n). 
We  shall  prove  (Theorem  3.3)  that  Og(M)  will  serve  as  a  Lipschitz  constant 
for  solutions  of  (M,  q)  when  M  is  a  P-matrix,  that  is  a  matrix  with  posi¬ 
tive  principal  minors  [4,  1],  or  more  generally  (Theorem  3.2)  for  perturba¬ 
tions  of  q  such  that  the  linear  complementarity  problem  is  uniquely  solvable 
along  the  line  joining  the  original  q  and  the  perturbed  q.  We  will  also 
establish  Lipschitz  continuity  for  solutions  of  (M,  q)  when  M  is  a  hidden 
Z-matrix  (Theorem  3.5).  We  begin  with  a  lemma.  A  related  result  to  this 
lemma  appears  in  [12]. 

12  n 

3.1  Lemma  Let  q  and  q  be  fixed  distinct  vectors  In  R  and  let 

q(t):=  (l-t)q1  +  tq2  for  te[0,l].  Assume  that  (M,q(t))  is  solvable  for 

te  [0,1].  Then  there  exists  a  partition  0  *  tQ  <  t-j  <  . <  tN  =  1  such 

that  for  1  <  i  <  N 


(3.4)  q(t.  )  e  Q(J1),  q(  t^ )  €  Q ( Jj )  for  some  c{l,...,n} 

Proof  Let 

T( J) :=  (t|tc  [0,1],  q(t)  c  Q(J)} 

for  Jc{l . n).  It  is  easy  to  see  that  T(J)  Is  closed  and  convex  and 

hence  it  is  a  closed  Interval  which  may  degenerate  to  a  single  point  or  to 
the  empty  set.  Since  (M,q(t))  is  solvable  for  t  c  [0,1]  it  follows  that 


Let 


[0,1]  c  u  T(J) 
0^ {1 ,.. • ,n} 


L:=  {[^ ,  u,]. 


»[^k»  u^]} 
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be  the  set  of  maximal  Intervals  in  (T(J)  |  J  c  {1 . .  ,n}},  that  Is  there  is  no 
other  interval  T(J),  Jc{l,...,n}  that  properly  contains  [Ap  u^].  By  re¬ 
moving  duplicates  from  L  if  needed,  we  can  assume  that  [A.j ,  u.j],. . .  ,[AK,  uK] 

are  distinct  and  that  A^  <  <  .  <  Since  eac^  te  [0,1]  belongs 

T(J)  (for  some  Jc{l . n})  which  is  either  in  L  or  contained  in  some 

interval  of  L,  we  have  that 

K 

[0,1]  c  U  [A.,u.] 

1=1  1  1 

Thus  Uj_i»  otherwise  (u^p  A^ )  would  be  an  uncovered  gap  of 

[0,1],  Also  u.j  ^  <  u. ,  otherwise  [A.,Uj]  would  not  be  maximal  because 
it  would  be  contained  In  [fi, . _ ^ ,  u^  ,]. 

Hence  A1  *  0,  £^_-j  <  A^  <_  u.. <  u^  and  uR  =  1 .  Let 

0  =  t0<ti< . <  t^  =  1  be  the  sorted  numbers  of  {A^ ,  u^ ,  A2,  u2, . . .  ,AK,  uK> 

with  duplicates  removed.  Then  each  Interval  [t^pt^]  is  contained  In 
some  interval  TfJ^ )  in  L  and  so 

q(t1.1)  €  Q(J1 )  and  q(ti)eQ(Ji)  □ 

We  establish  now  the  Lipschitz  continuity  of  linear  complementarity 
problems  with  unique  solutions  along  the  line  segment 
q(t):=  (1  -  t)q]  +  tqZ,  te  [0,1]. 

3.2  Theorem  (Lipschitz  continuity  of  uniquely  solvable  linear  complementarity 

problems)  Let  q^  and  q2  be  points  in  Rn  such  that  the  linear  comple- 

mentarity  problem  (M,q(t))  with  q(t):=  (l-t)q  +  tq  has  a  unique  solu- 

1  12 

tlon  for  each  te  [0,1].  Then  the  unique  solutions  x  of  (M,  q  )  and  x 
of  (M,q2)  satisfy 


II*1  -  x2ll„  i  -  q2ne 


where  Og(M)  is  defined  by  (3.3) 


Proof  There  exist  0  =  tg  <  t^  <  .  <  t^  =  1  with  properties  stated  in 

Lemma  3.1.  Let  x(t.)  be  the  unique  solution  of  (N.q(t^)).  Since  for 
1  <  1  <  N,  q(tj_j)  q(t^)  belong  to  Q(J^)  for  some  <=  (1  ,...,n), 

there  exists  a  solution  y(t^  -j)  of  (M,  q(t^ _1 ) )  such  that  by  (2.4) 
and  (3.3)  it  follows  that 


l|x(ti) -y(ti_1)|loo  < 


(3.5) 


Ki  •  h 

Ji*  J1 

!3.;  M3. 

i  i 


llq(ti)-q(ti_i)MB 


<  o0(M)  (ti  -  ti-1)||q1  -q2||6 


where  Ji  Is  the  complement  of  Ji  in  (1 . n).  Summing  up  for  1=1 . 1 

gives 

^  l|x(t1 )  -y{t1.1)lL  <  og(M)  IJq1  -  q2||  & 

Since  (M,q(tj_j))  has  a  unique  solution,  y(t^-j)  =  x(tj_j).  Hence 

HX1  -  x2lL  1  l  llx(t1 )  -  x(t1_1 )  11^  <,  ob(N)  llq1  -q2||B  □ 


Since  for  P-matrlx  M,  the  linear  complementarity  problem  (M,  q)  has 
a  unique  solution  for  each  qeRn  [10],  the  following  theorem  is  an 
immediate  corollary  to  Theorem  3.2. 


3.3  Theorem  (Llpschitz  continuity  of  solutions  of  linear  complementarity 

1  2 

problems  with  P-matrices)  Let  M  be  a  P-matrlx.  For  each  q  and  q 
In  Rn  the  corresponding  unique  solutions  x^  and  x2  of  (M,q^)  and 

p 

(M,  q  )  respectively,  satisfy 


II*1  -xZ|l„  <  VM)  1111 -<l2 II 6 


where  Og(M)  Is  defined  by  (3.3). 

The  following  example  shows  that  solutions  of  positive  semldeflnlte 
linear  complementarity  problems  may  not  be  Llpschltzlan. 


3.4  Exampl e 


e  >  0 


q(t)  = 


-e  +  2et 
1 


^0  =  t-j  *  %  ,  *  1 


^  =  *,  J2  =  {1,2} 

q(tQ)  and  q(t] )  are  In  QCJ, )  =  {q c  R2|q]  <  0,  q2 >  0} 

q(t-j )  and  q(t2)  are  In  Q(J2)  = 

r 

e 


y(tn)  =  x(tn) 


t  -  2et, 


x(t2)  = 


ro 


v°, 


In  order  to  satisfy  (3.5),  y(t^)  must  be 


.  However  (3.5)  also  requires 


that  x(t^)  =  .  Hence  x(t-j)  f  y(t-j)  and  the  proof  of  Theorem  3.2  fails. 


-23- 


II x( t2>  -  x(tQ)JJc 
In  fact  since  lim - 5 - ? - 

llq-q^L 

problem  cannot  be  Lipschitzlan. 


=  the  solutions  of  the 


We  conclude  by  showing  that  other  linear  complementarity  problems  which 
can  be  formulated  as  linear  programs  [7]  have  solutions  which  are  Lipschitzian 
with  respect  to  their  right  hand  sides  as  a  consequence  of  Theorem  2.4. 

In  particular  if  M  satisfies  the  condition  of  Theorem  2  of  [7]  with  c  =  0, 
that  is 

(3.6)  MZ1  =  Z2,  rZ1  +  sZ2  >  0,  (r,s)  >  0 

for  some  n*n  Z-matrices  Z^  and  Z2,  and  some  n- vectors  r  and  s,  then 
a  solution  to  such  a  linear  complementarity  problem  is  obtained  by  solving  the 
single  linear  program 

minpx  s.t.  Mx  +  q.>0,  x_>0 

where  p  =  r  +  MTs,  and  hence  p  is  independent  of  q.  In  the  terminology  of 
[14],  such  a  matrix  M  is  called  a  hidden  Z-matrix  and  is  a  generalization  of 
Z-matrix  which  includes  such  matrices  as  those  with  a  strictly  dominant  diag¬ 
onal,  and  all  matrices  of  Table  1  of  [7]  except  cases  12  to  14. 

3.5  Theorem  (Lipschitz  continuity  of  solutions  of  linear  complementarity 
problems  with  hidden  Z-matrices)  Let  M  be  a  hidden  Z-matrix,  that  is  M 
satisfies  (3.6).  For  each  q^  and  q^  in  Rn  for  which  (M,q^)  and  (M,  q2) 
are  solvable,  there  exist  solutions  x  of  (M,  q  )  and  x  of  (M,  q  )  such  as 


where  IMIg  is  some  norm  on  R  and  is  defined  by  (2.20). 

1  2 

Proof  By  [7],  there  exist  solutions  of  (M,  q  )  and  (M,  q  )  which  are 
obtained  by  solving  the  linear  programs 

min  {px|Mx  +  q^£0,  x>_0} 
min  (px|Mx  +  q  ^0,  x^O} 

1  2 

where  p  is  a  fixed  vector  Independent  of  q  and  q  .  The  conclusion  of 
the  theorem  follows  immediately  from  Theorem  2.4.  □ 

We  note  that  for  the  case  of  a  strictly  diagonally  dominant  and  hence 
positive  definite  matrix  M,  (M,  q)  Is  uniquely  solvable  for  each  q  In 
Rn,  and  the  Lipschitz  continuity  of  the  solution  follows  also  from  either 
Theorem  3.5  or  Theorem  3.3. 


til 
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